Multi-task Learning by Leveraging the Semantic Information
نویسندگان
چکیده
One crucial objective of multi-task learning is to align distributions across tasks so that the information between them can be transferred and shared. However, existing approaches only focused on matching marginal feature distribution while ignoring semantic information, which may hinder performance. To address this issue, we propose leverage label in by exploring conditional relations among tasks. We first theoretically analyze generalization bound based notion Jensen-Shannon divergence, provides new insights into value learning. Our analysis also leads a concrete algorithm jointly matches controls divergence. confirm effectiveness proposed method, compare with several baselines some benchmarks then test algorithms under space shift conditions. Empirical results demonstrate method could outperform most achieve state-of-the-art performance, particularly showing benefits
منابع مشابه
Semantic Segmentation via Multi-task, Multi-domain Learning
We present an approach that leverages multiple datasets possibly annotated using different classes to improve the semantic segmentation accuracy on each individual dataset. We propose a new selective loss function that can be integrated into deep networks to exploit training data coming from multiple datasets with possibly different tasks (e.g., different label-sets). We show how the gradient-r...
متن کاملKASIMIR - Work process embedded task management leveraging the Semantic Desktop
The effectiveness of semantic applications can be increased significantly if the system does not urge the users to take care of explicit semantic annotation creation. Today, semantic annotation creation is a well known bottleneck in semantic applications for enterprises. On the other hand semantic technologies have already proven to facilitate, e.g., a more efficient information management espe...
متن کاملLeveraging Domain-Independent Information in Semantic Parsing
Semantic parsing is a domain-dependent process by nature, as its output is defined over a set of domain symbols. Motivated by the observation that interpretation can be decomposed into domain-dependent and independent components, we suggest a novel interpretation model, which augments a domain dependent model with abstract information that can be shared by multiple domains. Our experiments show...
متن کاملMedweb Task: Identify Multi-Symptoms from Tweets Based on Active Learning and Semantic Information
Recently, the web have an ever increasing number of medical or clinical related information. Among all the data sources, social media is the most valuable. Ntcir-13 Medweb (medical Natural Language Processing for Web documents) releases the task which identifying the patient symptoms from text. This task exploits pseudo twitter messages as a cross language corpus covering Japanese, English, and...
متن کاملRepresentation Learning Using Multi-Task Deep Neural Networks for Semantic Classification and Information Retrieval
Methods of deep neural networks (DNNs) have recently demonstrated superior performance on a number of natural language processing tasks. However, in most previous work, the models are learned based on either unsupervised objectives, which does not directly optimize the desired task, or singletask supervised objectives, which often suffer from insufficient training data. We develop a multi-task ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Proceedings of the ... AAAI Conference on Artificial Intelligence
سال: 2021
ISSN: ['2159-5399', '2374-3468']
DOI: https://doi.org/10.1609/aaai.v35i12.17323